Wide-angle image providing system

ABSTRACT

The present invention relates to a wide-angle image providing system including: a first camera module for generating a first area image generated by capturing a first area; a second camera module for generating a second area image generated by capturing a second area which is adjacent to the first area; and calibration processing unit for carrying out distortion correction and phase difference correction for the first and second area images, respectively, and carrying out overlap correction and color correction for the first and second area images which have been calibrated for phase difference.

TECHNICAL FIELD

An embodiment of the present invention relates to a system for providinga wide-angle image.

BACKGROUND ART

In general, a CCTV camera is used for security purposes of general homesor is installed to prevent trespassing, robbery or a fire at places,such as a department, a bank and an exhibition hall, and to rapidlyprocess an accident although the accident occurs.

In particular, such a CCTV camera system is installed at a specificplace for a special purpose and is used for the purpose of monitoring animage at a remote place in order to surveil all situations. In general,the CCTV camera is installed at the top of a wall surface or the ceilingof a building so that as wide an area as possible can be surveiled andset toward a specific direction.

However, in general, a camera used for CCTV as described above has aview angle in the range of 30° to 70° and has a blind spot due to alimited photographing range. In order to reduce such a blind spot, thecamera uses a wide-angle lens, such as a fish-eye lens.

However, the camera on which the wide-angle lens is mounted hascharacteristics in that it has a short focal distance and a wide fieldof view (FOV), compared to a case where a standard lens is used. A formof an image obtained by the camera experiences a thing distortionphenomenon due to radial distortion.

Furthermore, an image captured by a panorama camera according to aconventional technology has a problem in that a location distortionphenomenon occurs.

DISCLOSURE Technical Problem

The present invention has been made to solve the aforementionedproblems. A system for providing a wide-angle image according to thepresent invention is to provide a wide-angle image not having a blindspot and not having wide-angle distortion, distance distortion, anintensity difference and chromatic aberration, to output an image in aVR form by providing a wide-angle image not having distortion, and toprevent distortion from occurring even when an image is reduced orenlarged.

Furthermore, a system for providing a wide-angle image according to thepresent invention is to provide a wide-angle image by using variouscamera modules, such as a camera for a mobile, a camera for CCTV, and aweb camera, and through calibration using a dedicated program or adedicated mobile application.

Furthermore, a system for providing a wide-angle image according to thepresent invention is to provide a method and system for providing awide-angle image, which may be applied to all industries in which acamera is used, such as a vehicle, a drone, a mobile, a camera, a ship,a rocket, medical treatment, national defense, homes, and leisure.

Technical Solution

A system for providing a wide-angle image according to an embodiment ofthe present invention for solving the aforementioned problems includes afirst camera module generating a first area image of a first area; asecond camera module generating a second area image of a second areaneighboring the first area; and a calibration processor calibratingdistortion and a phase difference between the first and second areaimages and calibrating superimposition and color of the first and secondarea images whose phase differences have been calibrated.

According to another embodiment of the present invention, thecalibration processor may include a distortion calibration unitcalibrating the distortion of each of the first and second area images;a phase difference calibration unit calibrating the phase difference ofeach of the first and second area images whose distortion has beencalibrated; an overlap calibration unit calibrating the first and secondarea images whose phases have been calibrated in an overlap manner sothat the first and second area images neighbor each other; and a colorcalibration unit calibrating the color of the superimposed andcalibrated overlap image.

According to another embodiment of the present invention, the distortioncalibration unit may calibrate wide-angle distortion of each of thefirst and second area images and then calibrate distance distortion. Thephase difference calibration unit may extract a horizontal referencepoint of the first and second area images and adjust locations of thefirst and second area images by rotating and moving coordinates. Theoverlap calibration unit may adjust the size of each of the first andsecond area images and then adjust locations of the first and secondarea images so that the first and second area images overlap by movingthe coordinates. The color calibration unit may calibrate brightness andchromatic aberration of the superimposed and calibrated overlap image.

According to another embodiment of the present invention, photographingfaces of the first camera module and the second camera module,respectively, may be disposed at an angle of 110° to 135°.

A system for providing a wide-angle image according to anotherembodiment of the present invention includes a first camera modulegenerating a first area image of a first area; a second camera modulegenerating a second area image of a second area neighboring the right ofthe first area; a third camera module generating a third area image of athird area neighboring the lower side of the first area or generating athird area image of a third area which is the opposite side of the firstarea; a fourth camera module generating a fourth area image of a fourtharea neighboring the lower side of the second area and the right of thethird area or generating a fourth area image of a fourth area which isthe opposite side of the second area and neighbors the left of the thirdarea; and a calibration processor calibrating distortion and a phasedifference of each of the first, second, third and fourth area imagesand calibrating superimposition and color of the first, second, thirdand fourth area images whose phase differences have been calibrated.

According to another embodiment of the present invention, thecalibration processor may include a distortion calibration unitcalibrating the distortion of each of the first, second, third andfourth area images; a phase difference calibration unit calibrating thephase difference of each of the first, second, third and fourth areaimages whose distortion has been calibrated; an overlap calibration unitcalibrating the first, second, third and fourth area images whose phaseshave been calibrated in an overlap manner so that the first, second,third and fourth area images neighbor each other; and a colorcalibration unit calibrating the color of the superimposed andcalibrated overlap image.

According to another embodiment of the present invention, the distortioncalibration unit may calibrate wide-angle distortion of each of thefirst, second, third and fourth area images and then calibrate distancedistortion. The phase difference calibration unit may extract ahorizontal reference point of the first, second, third and fourth areaimages and then adjust locations of the first, second, third and fourtharea images by rotating and moving coordinates. The overlap calibrationunit may adjust the size of each of the first, second, third and fourtharea images and then adjust locations of the first, second, third andfourth area images so that the first, second, third and fourth areaimages overlap by moving the coordinates. The color calibration unit mayadjust brightness and chromatic aberration of the superimposed andcalibrated overlap image.

According to another embodiment of the present invention, the firstcamera module may include a first lens module; a first image sensormodule generating the first area image of the first area photographedthrough the first lens module; and a first structure in which the firstlens module and the first image sensor module are received. The secondcamera module may include a second lens module; a second image sensormodule generating the second area image of the second area photographedthrough the second lens module; and a second structure in which thesecond lens module and the second image sensor module are received. Thethird camera module may include a third lens module; a third imagesensor module generating the third area image of the third areaphotographed through the third lens module; and a third structure inwhich the third lens module and the third image sensor module arereceived. The fourth camera module may include a fourth lens module; afourth image sensor module generating the fourth area image of thefourth area photographed through the fourth lens module; and a fourthstructure in which the fourth lens module and the fourth image sensormodule are received.

According to another embodiment of the present invention, The system mayfurther include first and second link units each coupled to one side ofeach of the first and second camera modules; third and fourth link unitseach coupled to one side of each of the third and fourth camera modules;and a circular plate rotated by a motor and comprising curve grooveswhere the first, second, third and fourth link units are coupled andmoved.

According to another embodiment of the present invention, the first andsecond camera modules may each have the other side, facing the one side,mutually coupled by hinges. The third and fourth camera modules may eachhave the other side, facing the one side, mutually coupled by hinges.The first and second link units may be moved in the curve grooves by therotation of the circular plate and adjust an angle formed by the firstand second camera modules. The third and fourth link units may be movedin the curve grooves by the rotation of the circular plate and adjust anangle formed by the third and fourth camera modules.

Advantageous Effects

According to an embodiment of the present invention, a wide-angle imagenot having a blind spot and not having wide-angle distortion, distancedistortion, an intensity difference and chromatic aberration can beprovided.

Furthermore, according to an embodiment of the present invention, animage can be output in a VR form by providing a wide-angle image nothaving distortion, and distortion does not occur even when an image isreduced or enlarged.

Furthermore, according to an embodiment of the present invention, awide-angle image can be provided using various camera modules, such as acamera for a mobile, a camera for CCTV, and a web camera, and throughcalibration using a dedicated program or a dedicated mobile application.

Moreover, according to an embodiment of the present invention, an imagehaving a wide view angle can be provided, which is applied to allindustries in which a camera is used, such as a vehicle, a drone, amobile, a camera, a ship, a rocket, medical treatment, national defense,homes, and leisure.

DESCRIPTION OF DRAWINGS

FIG. 1 shows a configuration of a system for providing a wide-angleimage according to an embodiment of the present invention.

FIG. 2 is a flowchart for describing a method of providing a wide-angleimage according to an embodiment of the present invention.

FIG. 3 is a diagram for describing the photographing areas of first andsecond cameras according to an embodiment of the present invention.

FIGS. 4 to 8 are diagrams for describing a process of calibrating firstand second area images, for describing a method of providing awide-angle image according to an embodiment of the present invention.

FIGS. 9 and 10 are diagrams showing locations where first and secondcameras are disposed according to an embodiment of the presentinvention.

FIGS. 11 and 12 are diagrams showing photographing deployment angles ofthe first and second cameras according to locations where the first andsecond cameras are disposed according to an embodiment of the presentinvention.

FIGS. 13 to 15 are diagrams showing calibration booths for thecalibration of a method of providing a wide-angle image according to anembodiment of the present invention.

FIG. 16 is a perspective view of a camera module of the system forproviding a wide-angle image according to an embodiment of the presentinvention.

FIG. 17 is a development figure of the camera module of the system forproviding a wide-angle image according to an embodiment of the presentinvention.

FIG. 18 is a diagram for describing a method of adjusting the deploymentand angle of the camera module of the system for providing a wide-angleimage according to an embodiment of the present invention.

FIG. 19 shows a configuration of a system for providing a wide-angleimage according to another embodiment of the present invention.

FIG. 20 is a flowchart for describing a method of providing a wide-angleimage according to another embodiment of the present invention.

FIGS. 21 to 25 are diagrams for describing a process of calibratingfirst, second, third and fourth area images, for describing the methodof providing a wide-angle image according to another embodiment of thepresent invention.

FIGS. 26 to 28 are diagrams showing calibration booths for thecalibration of the method of providing a wide-angle image according toanother embodiment of the present invention.

FIG. 29 is a diagram showing photographing deployment angles of first,second, third and fourth cameras according to places where the first,second, third and fourth cameras are disposed according to anotherembodiment of the present invention.

FIG. 30 is a perspective view of a camera module of the system forproviding a wide-angle image according to another embodiment of thepresent invention.

FIG. 31 is a development figure of the camera module of the system forproviding a wide-angle image according to another embodiment of thepresent invention.

FIGS. 32 to 36 are diagrams for describing a process of calibratingfirst, second, third and fourth area images, for describing a method ofproviding a wide-angle image according to still another embodiment ofthe present invention.

FIGS. 37 to 39 are diagrams showing calibration booths for thecalibration of the method of providing a wide-angle image according tostill another embodiment of the present invention.

FIG. 40 is a diagram showing photographing deployment angles of first,second, third and fourth cameras according to places where the first,second, third and fourth cameras are disposed according to still anotherembodiment of the present invention.

FIG. 41 shows a configuration of a camera module of a system forproviding a wide-angle image according to still another embodiment ofthe present invention.

FIG. 42 is a perspective view of the camera module of the system forproviding a wide-angle image according to still another embodiment ofthe present invention.

FIG. 43 is a diagram for describing a method of adjusting an angle ofthe camera module of the system for providing a wide-angle imageaccording to still another embodiment of the present invention.

FIG. 44 is a development figure of the camera module of the system forproviding a wide-angle image according to still another embodiment ofthe present invention.

MODE FOR INVENTION

Hereinafter, embodiments of the present invention are described indetail with reference to the accompanying drawings. However, indescribing the embodiments, a detailed description of the known functionor element related to the present invention will be omitted if it isdeemed to make the gist of the present invention unnecessarily vague.

Furthermore, it is to be noted that in the drawings, the size of eachelement may have been exaggerated and does not correspond to an actualsize.

FIG. 1 shows a configuration of a system for providing a wide-angleimage according to an embodiment of the present invention. Hereinafter,the configuration of the system for providing a wide-angle imageaccording to an embodiment of the present invention is described withreference to FIG. 1.

As shown FIG. 1, the system for providing a wide-angle image accordingto an embodiment of the present invention may be configured to include afirst camera module 110, a second camera module 120, calibrationprocessor 130 and an image storage unit 140. Furthermore, thecalibration processor 130 may be configured to include a distortioncalibration unit 131, a phase difference calibration unit 132, anoverlap calibration unit 133 and a color calibration unit 134.

The first camera module 110 generates a first area image of a firstarea. The second camera module 120 generates a second area image of asecond area neighboring the first area.

More specifically, the first camera module 110 may generate a first areaimage, that is, a left image, by photographing an area corresponding tothe left of an area to be photographed. The second camera module 120 maygenerate a second area image, that is, a right image, by photographingan area corresponding to the right of an area to be photographed.

In this case, each of the photographing faces of the first camera module110 and the second camera module 120 is disposed at an angle of 110° to135°. Images photographed by the first camera module 110 and the secondcamera module 120 may provide images having view angles of left andright 180° to 200° and up and down 90° to 110°, respectively.

Images photographed by the first and second cameras 110 and 120 asdescribed above may include wide-angle distortion and distancedistortion. If images photographed using two cameras are overlapped toneighbor each other, a phase difference, an overlap area, an intensitydifference or chromatic aberration occurs.

Accordingly, as described above, the calibration processor 130calibrates distortion, a phase difference, an overlap area, an intensitydifference or chromatic aberration of an image. That is, the calibrationprocessor 130 performs a distortion calibration and a phase differencecalibration on the first and second area images photographed by thefirst and second cameras 110 and 120, and performs an overlapcalibration and a color calibration on the first and second area imageswhose phase differences have been calibrated.

More specifically, the calibration processor 130 may be configured toinclude the distortion calibration unit 131, the phase differencecalibration unit 132, the overlap calibration unit 133 and the colorcalibration unit 134.

The distortion calibration unit 131 may calibrate distortion of thefirst area image photographed by the first camera module 110. The phasedifference calibration unit 132 may perform a phase differencecalibration on each of the first and second area images whose distortionhas been calibrated. Furthermore, the overlap calibration unit 133 maycalibrate the first and second area images, each one having its phasecalibrated, in an overlap manner so that the first and second areaimages neighbor each other. The color calibration unit 134 may perform acolor calibration on the superimposed and calibrated overlap images.

This is more specifically described. The distortion calibration unit 131may perform a wide-angle distortion calibration on each of the first andsecond area images, and may then calibrate distance distortion. Thephase difference calibration unit 132 may extract the horizontalreference point of the first and second area images, and may then adjustthe locations of the first and second area images by rotating and movingcoordinates. The overlap calibration unit 133 may adjust the size ofeach of the first and second area images, and may then adjust thelocations of the first and second area images so that they overlap eachother by moving the coordinates. The color calibration unit 134 mayadjust brightness and chromatic aberration of the superimposed andcalibrated overlap images.

The image storage unit 140 may store the images calibrated and composedby the calibration processor 130 as described above.

Accordingly, according to an embodiment of the present invention, awide-angle image not having a blind spot and not having wide-angledistortion, distance distortion, an intensity difference and chromaticaberration can be provided.

FIG. 2 is a flowchart for describing a method of providing a wide-angleimage according to an embodiment of the present invention. FIG. 3 is adiagram for describing the photographing areas of first and secondcameras according to an embodiment of the present invention.

Furthermore, FIGS. 4 to 8 are diagrams for describing a process ofcalibrating first and second area images, for describing a method ofproviding a wide-angle image according to an embodiment of the presentinvention.

Hereinafter, the method of providing a wide-angle image according to anembodiment of the present invention is described with reference to FIGS.2 to 8.

First, as shown in FIG. 2, the first camera module corresponding to aleft camera generates and extracts a first area image of a first area(S210). The second camera module corresponding to a right cameragenerates and extracts a second area image of a second area neighboringthe first area (S211).

The first and second area images extracted as described above includedistance distortion and wide-angle distortion. Accordingly, thedistortion calibration unit calibrates wide-angle distortion anddistance distortion of each of the first and second area images withreference to a distortion constant (S220, S221).

FIG. 4 shows the first and second area images whose wide-angledistortion and distance distortion have been calibrated as describedabove.

Thereafter, the phase difference calibration unit extracts thehorizontal reference point of the first and second area images whosewide-angle distortion and distance distortion have been calibrated withreference to a phase difference constant, adjusts the locations of thefirst and second area images by rotating and moving coordinates as inFIG. 5 (S230, S231), and stores the first and second area images whosecoordinates have been rotated and moved and whose locations have beenadjusted (S235, S236).

Thereafter, the overlap calibration unit adjusts the sizes of the storedfirst and second area images with reference to an overlap constant, andthen adjusts the locations of the first and second area images so thatthe locations overlap by moving the coordinates as in FIG. 6 (S240).

Referring to FIG. 3, the images whose locations have been adjusted andoverlapped are composed of the first area image 111 of the first areaphotographed by the first camera module 110 and the second area image121 of the second area photographed by the second camera module 120. Anarea 301 overlapped between the first area and the second area occurs.The overlapped area 301 is divided into a first camera modulecalibration area 112 and a second camera module calibration area 122.

As shown in FIG. 7, the color calibration unit generates and stores animage in which the first and second area images are overlapped andcomposed as in FIG. 8 by adjusting brightness and chromatic aberrationof the superimposed and calibrated overlap image with reference to acolor constant (S250, S255), and may output the composite image storedas described above (S260).

FIGS. 9 and 10 are diagrams showing locations where first and secondcameras are disposed according to an embodiment of the presentinvention. FIGS. 11 and 12 are diagrams showing photographing deploymentangles of the first and second cameras according to locations where thefirst and second cameras are disposed according to an embodiment of thepresent invention.

Furthermore, FIGS. 13 to 15 are diagrams showing calibration booths forthe calibration of a method of providing a wide-angle image according toan embodiment of the present invention.

Hereinafter, photographing angles of the first and second camerasaccording to the deployment of the first and second cameras according toan embodiment of the present invention are described with reference toFIGS. 9 to 12.

If the first and second cameras are disposed on the side verticallyupright from the ground, such as a wall surface, as in FIG. 9, thephotographing faces of the first and second cameras may be disposed atan angle of 110° to 135°, and the first and second cameras and the wallsurface may be disposed to form an angle of 27° to 35° as in FIG. 11.Accordingly, an image of areas other than the corresponding side (wallsurface) may be provided.

Furthermore, if the first and second cameras are disposed toward theground, such as a place such as a ceiling, as in FIG. 10, thephotographing faces of the first and second cameras may be disposed atan angle of 110° to 135° as in FIG. 12. Accordingly, an image of allfaces on both sides and an image of the remaining some faces on bothsides may be provided.

FIG. 13 shows a calibration booth for calibrating wide-angle distortionand distance distortion according to an embodiment of the presentinvention. FIG. 14 shows a calibration booth for calibrating an overlapimage according to an embodiment of the present invention.

Furthermore, FIG. 15 shows a calibration booth for calibratingbrightness and chromatic aberration of an area image according to anembodiment of the present invention.

Accordingly, according to an embodiment of the present invention, awide-angle image not having a blind spot and not having wide-angledistortion, distance distortion, an intensity difference and chromaticaberration can be provided. An image can be output in a VR form byproviding a wide-angle image not having distortion. Distortion does notoccur even when an image is reduced or enlarged.

Moreover, according to an embodiment of the present invention, an imagehaving a wide view angle can be provided by applying the image to allindustries in which a camera is used, such as a vehicle, a drone, amobile, the camera, a ship, a rocket, medical treatment, nationaldefense, homes, and leisure.

FIG. 16 is a perspective view of a camera module of the system forproviding a wide-angle image according to an embodiment of the presentinvention. FIG. 17 is a development figure of the camera module of thesystem for providing a wide-angle image according to an embodiment ofthe present invention. FIG. 18 is a diagram for describing a method ofadjusting the deployment and angle of the camera module of the systemfor providing a wide-angle image according to an embodiment of thepresent invention.

Referring to FIGS. 16 and 17, the first camera module 110 according toan embodiment of the present invention is configured to include a firstlens module 111, a first image sensor module 112 and a first structure113.

The first image sensor module 112 generates a first area image of afirst area photographed through the first lens module 111. The firststructure 113 may be configured to receive the first lens module 111 andthe first image sensor module 112.

Likewise, the second camera module 120 is configured to include a secondlens module 121, a second image sensor module 122 and a second structure123. The second image sensor module 122 generates a second area image ofa second area photographed through the second lens module 121. Thesecond structure 123 may be configured to receive the second lens module121 and the first image sensor module 122.

In this case, the first and second structures 113 and 123 may beconfigured using aluminum frames in order to reduce weight.

Furthermore, each of first and second link units 115 and 125 is coupledto one side of each of the first and second camera modules 110 and 120.A circular plate 150 is fixed to a fixing plate 160 and rotated by amotor. The circular plate 150 may be configured to include curve grooves151 in which the first and second link units 115 and 125 are coupled andmoved, respectively.

Accordingly, the first and second camera modules 110 and 120 each areconfigured to have the other side, facing the one side, mutually coupledby hinges. The first and second link units 115 and 125 may adjust anangle formed by the first and second camera modules 110 and 120 bymoving the curve grooves 151 by the rotation of the circular plate 150.

When the angle between the first and second camera modules 110 and 120is adjusted, the angle between the first and second camera modules 110and 120 may be adjusted by rotating the circular plate 150 throughcontrol of the motor, and an optimum image photographing angle can beobtained through zoom-in and zoom-out.

Referring to FIG. 18, an angle of the first and second camera modules110 and 120 may be determined based on a view angle of the first andsecond camera modules 110 and 120.

α=(180°−a)×(2/3)  [Equation 1]

(In this case, a is an angle formed by each of the first and secondcamera modules and a floor surface, and a is a horizontal view angle ofthe first and second camera modules)

β=(180°−b)×(1/3)  [Equation 2]

(In this case, β is an angle of the image module of each of the firstand second camera modules, and b is a vertical view angle of each of thefirst and second camera modules)

According to an embodiment of the present invention, as shown in FIGS.16 and 18, when the first and second camera modules 110 and 120 aredisposed, an angle formed by each of the first and second camera modules110 and 120 and the floor surface may be calculated using Equation 1. Anangle of each of the image modules 112 and 122 of the first and secondcamera modules 110 and 120 may be calculated using Equation 2. FIG. 19shows a configuration of a system for providing a wide-angle imageaccording to another embodiment of the present invention. Hereinafter,the configuration of the system for providing a wide-angle imageaccording to another embodiment of the present invention is describedwith reference to FIG. 19.

As shown FIG. 19, the system for providing a wide-angle image accordingto another embodiment of the present invention may be configured toinclude a first camera module 110, a second camera module 115, a thirdcamera module 120, a fourth camera module 125, a calibration processor130 and an image storage unit 140. Furthermore, the calibrationprocessor 130 may be configured to include a distortion calibration unit131, a phase difference calibration unit 132, an overlap calibrationunit 133 and a color calibration unit 134.

The first camera module 110 generates a first area image of a firstarea. The second camera module 115 generates a second area image of asecond area that neighbors the right of the first area. The third cameramodule 120 generates a third area image of a third area that neighborsthe lower side of the first area. The fourth camera module 125 generatesa fourth area image of a fourth area that neighbors the lower side ofthe second area and the right of the third area.

More specifically, the first camera module 110 may generate a first areaimage, that is, an up-left image, by photographing an area correspondingto the up-left of an area to be photographed. The second camera module115 may generate a second area image, that is, an up-right image, byphotographing an area corresponding to the up-right of an area to bephotographed. Likewise, the third camera module 120 may generate a thirdarea image, that is, a down-left image, by photographing an areacorresponding to the down-left of an area to be photographed. The fourthcamera module 125 may generate a fourth area image, that is, adown-right image, by photographing an area corresponding to thedown-right of an area to be photographed.

The images photographed by the first, second, third and fourth cameramodules 110, 115, 120, and 125 as described above include wide-angledistortion and distance distortion. If images photographed by fourcameras are overlapped to neighbor each other, a phase difference, anoverlap area, an intensity difference or chromatic aberration occurs.

Accordingly, the calibration processor 130 calibrates distortion, aphase difference, an overlap area, an intensity difference or chromaticaberration of an image as described above. That is, the calibrationprocessor 130 performs distortion calibration and phase differencecalibration on each of the first, second, third and fourth area imagesphotographed by the first, second, third and fourth camera modules 110,115, 120, and 125, and performs overlap calibration and colorcalibration on the first, second, third and fourth area images whosephase differences have been calibrated.

More specifically, the calibration processor 130 may be configured toinclude the distortion calibration unit 131, the phase differencecalibration unit 132, the overlap calibration unit 133 and the colorcalibration unit 134.

The distortion calibration unit 131 calibrates the distortion of thefirst, second, third and fourth area images. The phase differencecalibration unit 132 calibrates a phase difference of each of the first,second, third and fourth area images whose distortion has beencalibrated.

Furthermore, the overlap calibration unit 133 calibrates the first,second, third and fourth area images whose phases have been calibratedin an overlap manner so that they neighbor each other. The colorcalibration unit 134 may calibrate a color of the superimposed andcalibrated overlap image.

This is more specifically described. The distortion calibration unit 131may calibrate distance distortion after performing wide-angle distortioncalibration on each of the first, second, third and fourth area images.The phase difference calibration unit 132 may extract the horizontalreference point of the first, second, third and fourth area images andthen adjust the locations of the first, second, third and fourth areaimages by rotating and moving coordinates. The overlap calibration unit133 may adjust the size of each of the first, second, third and fourtharea images and then adjust the locations of the first, second, thirdand fourth area images so that they overlap by moving the coordinates.The color calibration unit 134 may adjust brightness and chromaticaberration of the superimposed and calibrated overlap image.

The image storage unit 140 may store an image calibrated and composed bythe calibration processor 130 as described above.

Accordingly, according to an embodiment of the present invention, awide-angle image, not having a blind spot whose view angles are left andright 200° and up and down 200° and not having wide-angle distortion,distance distortion, an intensity difference and chromatic aberration,can be provided.

FIG. 20 is a flowchart for describing a method of providing a wide-angleimage according to another embodiment of the present invention. FIGS. 21to 25 are diagrams for describing a process of calibrating first,second, third and fourth area images, for describing the method ofproviding a wide-angle image according to another embodiment of thepresent invention.

Hereinafter, the method of providing a wide-angle image according toanother embodiment of the present invention is described with referenceto FIGS. 20 to 25.

First, as shown in FIG. 20, the first camera module corresponding to anup-left camera generates and extracts a first area image of a first area(S210). The second camera module corresponding to an up-right cameragenerates and extracts a second area image of a second area neighboringthe right of the first area (S211).

Furthermore, the third camera module corresponding to a down-left cameragenerates and extracts a third area image of a third area (S212). Thefourth camera module corresponding to a down-right camera generates andextracts a fourth area image of a fourth area neighboring the lower sideof the second area and the right of the third area (S213).

The first, second, third and fourth area images extracted as describedabove include distance distortion and wide-angle distortion.Accordingly, the distortion calibration unit calibrates the wide-angledistortion and distance distortion of each of the first, second, thirdand fourth area images with reference to a distortion constant (S220,S221, S222, and S223).

FIG. 21 shows the first, second, third and fourth area images whosewide-angle distortion and distance distortion have been calibrated asdescribed above.

Thereafter, the phase difference calibration unit extracts thehorizontal reference point of the first, second, third and fourth areaimages whose wide-angle distortion and distance distortion have beencalibrated, with reference to a phase difference constant, and thenadjusts the locations of the first, second, third and fourth area imagesby rotating and moving coordinates as in FIG. 22 (S230).

Thereafter, the overlap calibration unit adjusts the sizes of the storedfirst, second, third and fourth area images with reference to an overlapconstant, and then adjusts the locations of the first, second, third andfourth area images so that they overlap as in FIG. 23 by moving thecoordinates (S240).

The color calibration unit may generate an image in which the first,second, third and fourth area images are overlapped and composed, as inFIG. 25, by adjusting brightness and chromatic aberration of thesuperimposed and calibrated overlap image, as shown FIG. 24, withreference to a color constant and store the generated image (S250,S255), and may output the composite image stored as described above(S260).

FIGS. 26 to 28 are diagrams showing calibration booths for thecalibration of the method of providing a wide-angle image according toanother embodiment of the present invention.

FIG. 26 shows a calibration booth for calibrating wide-angle distortionand distance distortion according to another embodiment of the presentinvention. FIG. 27 shows a calibration booth for calibrating an overlapimage according to another embodiment of the present invention.

Furthermore, FIG. 28 shows a calibration booth for calibratingbrightness and chromatic aberration of an area image according toanother embodiment of the present invention.

Accordingly, according to another embodiment of the present invention, awide-angle image not having a blind spot and not having wide-angledistortion, distance distortion, an intensity difference and chromaticaberration can be provided. An image can be output in a VR form byproviding a wide-angle image not having distortion. Distortion does notoccur even when an image is reduced or enlarged.

Moreover, according to another embodiment of the present invention, animage having a wide view angle can be provided by applying the image toall industries in which a camera is used, such as a vehicle, a drone, amobile, the camera, a ship, a rocket, medical treatment, nationaldefense, homes, and leisure.

FIG. 29 is a diagram showing photographing deployment angles of thefirst, second, third and fourth cameras according to places where thefirst, second, third and fourth cameras are disposed according toanother embodiment of the present invention.

Hereinafter, photographing angles of the first, second, third and fourthcameras according to the deployment of the first, second, third andfourth cameras according to another embodiment of the present inventionare described with reference to FIG. 29.

According to another embodiment of the present invention, as in FIG.29(a), the first, second, third and fourth cameras may provide a frontimage having a wide view angle of left and right 200° and up and down200° without a blind spot.

Furthermore, as in FIG. 29(b), if the first, second, third and fourthcameras are disposed on the side vertically upright from the ground,such as a wall surface, they may photograph and provide an image ofareas other than a corresponding side (wall surface).

FIG. 30 is a perspective view of a camera module of the system forproviding a wide-angle image according to another embodiment of thepresent invention. FIG. 31 is a development figure of the camera moduleof the system for providing a wide-angle image according to anotherembodiment of the present invention.

Referring to FIG. 30, each of first, second, third and fourth cameramodules 110, 115, 120, and 125 according to another embodiment of thepresent invention may be configured to include a lens module 111, animage sensor module 112 and a structure 113.

The image sensor module 112 generates an area image of a correspondingarea photographed through the lens module 111. The structure 113 may beconfigured to receive the lens module 111 and the image sensor module112.

In this case, the structure 113 may be configured using an aluminumframe in order to reduce weight.

α=(180°−a)×(2/3)  [Equation 3]

(In this case, a is an angle between the first, second, third and fourthcamera modules, and a is an horizontal view angle of the first, second,third and fourth camera modules)

β=(180°−b)×(1/3)  [Equation 4]

(In this case, β is an angle of the image module of each of the first,second, third and fourth camera modules, and b is a vertical view angleof the first, second, third and fourth camera modules)

According to an embodiment of the present invention, as shown in FIG.31, in order to deploy the first, second, third and fourth cameramodules 110, 115, 120, and 125, angles between the first, second, thirdand fourth camera modules 110, 115, 120, and 125 may be calculated usingEquation 3. An angle of the image module 112 of each of the first,second, third and fourth camera modules 110, 115, 120, and 125 may becalculated using Equation 4 and disposed.

Hereinafter, the configuration of the system for providing a wide-angleimage according to still another embodiment of the present invention isdescribed with reference to FIG. 19.

As shown FIG. 19, the system for providing a wide-angle image accordingto still another embodiment of the present invention may be configuredto include the first camera module 110, the second camera module 115,the third camera module 120, the fourth camera module 125, thecalibration processor 130 and the image storage unit 140. Furthermore,the calibration processor 130 may be configured to include thedistortion calibration unit 131, the phase difference calibration unit132, the overlap calibration unit 133 and the color calibration unit134.

The first camera module 110 generates a first area image of a firstarea. The second camera module 115 generates a second area image of asecond area neighboring the right of the first area. The third cameramodule 120 generates a third area image of a third area, that is, theopposite side of the first area. The fourth camera module 125 generatesa fourth area image of a fourth area that is the opposite side of thesecond area and that neighbors the left of the third area.

More specifically, the first camera module 110 may generate the firstarea image, that is, a front left image, by photographing an areacorresponding to the front left. The second camera module 115 maygenerate the second area image, that is, a front right image, byphotographing an area corresponding to the front-up. Likewise, the thirdcamera module 120 may generate the third area image, that is, a backleft image, by photographing an area corresponding to the back left. Thefourth camera module 125 may generate the fourth area image, that is, aback right image, by photographing an area corresponding to the backright.

The images photographed by the first, second, third and fourth cameramodules 110, 115, 120, and 125 as described above include wide-angledistortion and distance distortion. If images captured by four camerasare overlapped to neighbor each other, a phase difference, an overlaparea, an intensity difference or chromatic aberration occurs.

Accordingly, the calibration processor 130 calibrates the distortion,phase difference, overlap area, intensity difference or chromaticaberration of the images as described above. That is, the calibrationprocessor 130 calibrates the distortion and phase difference of each ofthe first, second, third and fourth area images photographed by thefirst, second, third and fourth camera modules 110, 115, 120, and 125,and performs overlap calibration and color calibration on the first,second, third and fourth area images whose phase differences have beencalibrated.

More specifically, the calibration processor 130 may be configured toinclude the distortion calibration unit 131, the phase differencecalibration unit 132, the overlap calibration unit 133 and the colorcalibration unit 134.

The distortion calibration unit 131 calibrates the distortion of thefirst, second, third and fourth area images. The phase differencecalibration unit 132 calibrates the phase difference of each of thefirst, second, third and fourth area images whose distortion has beencalibrated. Furthermore, the overlap calibration unit 133 calibrates thefirst, second, third and fourth area images whose phases have beencalibrated in an overlap manner so that the first, second, third andfourth area images neighbor each other. The color calibration unit 134may calibrate a color of the superimposed and calibrated overlap image.

This is more specifically described. The distortion calibration unit 131may calibrate the wide-angle distortion of each of the first, second,third and fourth area images, and may then calibrate the distancedistortion of each of the first, second, third and fourth area images.The phase difference calibration unit 132 may extract the horizontalreference point of the first, second, third and fourth area images, andmay then adjust the locations of the first, second, third and fourtharea images by rotating and moving coordinates. The overlap calibrationunit 133 may adjust the size of each of the first, second, third andfourth area images, and may then adjust the locations of the first,second, third and fourth area images so that they overlap by moving thecoordinates. The color calibration unit 134 may adjust brightness andchromatic aberration of the superimposed and calibrated overlap image.

The image storage unit 140 may store an image calibrated and composed bythe calibration processor 130 as described above.

Accordingly, according to an embodiment of the present invention, awide-angle image not having a blind spot and not having wide-angledistortion, distance distortion, an intensity difference and chromaticaberration can be provided.

FIGS. 32 to 36 are diagrams for describing a process of calibratingfirst, second, third and fourth area images, for describing a method ofproviding a wide-angle image according to still another embodiment ofthe present invention.

Hereinafter, the method of providing a wide-angle image according tostill another embodiment of the present invention is described withreference to FIG. 20 and FIGS. 32 to 36.

First, as shown in FIG. 20, the first camera module corresponding to anup-left camera generates and extracts a first area image of a first area(S210). The second camera module corresponding to an up-right cameragenerates and extracts a second area image of a second area neighboringthe right of the first area (S211).

Furthermore, the third camera module corresponding to a back left cameragenerates and extracts a third area image of a third area (S212). Thefourth camera module corresponding to a back right camera generates andextracts a fourth area image of a fourth area neighboring the lower sideof the second area and the right of the third area (S213).

The first, second, third and fourth area images extracted as describedabove include distance distortion and wide-angle distortion.Accordingly, the distortion calibration unit calibrates the wide-angledistortion and distance distortion of each of the first, second, thirdand fourth area images with reference to a distortion constant (S220,S221, S222, and S223).

FIG. 32 shows the first and second area images whose wide-angledistortion and distance distortion have been calibrated as describedabove.

Thereafter, the phase difference calibration unit extracts thehorizontal reference point of the first, second, third and fourth areaimages whose wide-angle distortion and distance distortion have beencalibrated, with reference to a phase difference constant, and thenadjusts the locations of the first and second area images by rotatingand moving coordinates as in FIG. 33. Likewise, the phase differencecalibration unit also adjusts the locations of the third and fourth areaimages (S230).

Thereafter, the overlap calibration unit adjusts the sizes of the storedfirst, second, third and fourth area images with reference to an overlapconstant, and then adjusts the locations of first, second, third andfourth area images as in FIG. 34 by moving coordinates (S240).

The color calibration unit may adjust brightness and chromaticaberration of the superimposed and calibrated overlap image withreference to a color constant, as shown FIG. 35, may generate and storean image in which the first, second, third and fourth area images areoverlapped and composed as in FIG. 36 (S250, S255), and may output thecomposite image stored as described above (S260).

FIGS. 37 to 39 are diagrams showing calibration booths for thecalibration of the method of providing a wide-angle image according tostill another embodiment of the present invention.

FIG. 37 shows a calibration booth for calibrating wide-angle distortionand distance distortion according to an embodiment of the presentinvention. FIG. 38 shows a calibration booth for calibrating an overlapimage according to an embodiment of the present invention.

Furthermore, FIG. 39 shows a calibration booth for calibratingbrightness and chromatic aberration of an area image according to anembodiment of the present invention.

Accordingly, according to an embodiment of the present invention, awide-angle image not having a blind spot and not having wide-angledistortion, distance distortion, an intensity difference and chromaticaberration can be provided. An image can be output in a VR form byproviding a wide-angle image not having distortion. Distortion does notoccur even when an image is reduced or enlarged.

Moreover, according to an embodiment of the present invention, an imagehaving a wide view angle can be provided by applying the image to allindustries in which a camera is used, such as a vehicle, a drone, amobile, the camera, a ship, a rocket, medical treatment, nationaldefense, homes, and leisure.

FIG. 40 is a diagram showing photographing deployment angles of first,second, third and fourth cameras according to places where the first,second, third and fourth cameras are disposed according to still anotherembodiment of the present invention.

Hereinafter, photographing angles of the first, second, third and fourthcameras according to the deployment of the first, second, third andfourth cameras according to an embodiment of the present invention aredescribed with reference to FIG. 40.

As in FIG. 40(a), the first, second, third and fourth cameras mayprovide a front image having a wide view angle of left and right 360°and up and down 90° ˜100° without a blind spot in an area other than afloor and a ceiling.

Furthermore, as in FIG. 40(b), if the first, second, third and fourthcameras are disposed on the side vertically upright from the ground,such as a wall surface, they may photograph and provide an image of anarea other than the floor and the ceiling.

FIG. 41 shows a configuration of a camera module of a system forproviding a wide-angle image according to still another embodiment ofthe present invention. FIG. 42 is a perspective view of the cameramodule of the system for providing a wide-angle image according to stillanother embodiment of the present invention.

Furthermore, FIG. 43 is a diagram for describing a method of adjustingan angle of the camera module of the system for providing a wide-angleimage according to still another embodiment of the present invention.FIG. 44 is a development figure of the camera module of the system forproviding a wide-angle image according to still another embodiment ofthe present invention.

Referring to FIGS. 41 and 42, each of first, second, third and fourthcamera modules 110, 115, 120, and 125 according to an embodiment of thepresent invention may be configured to include a lens module 111, animage sensor module 112 and a structure 113.

The image sensor module 112 generates an area image of a correspondingarea photographed through the lens module 111.

The structure 113 may be configured to receive the lens module 111 andthe image sensor module 112.

In this case, the structure 113 may be configured using an aluminumframe in order to reduce weight. A fixed type system for providing awide-angle image according to an embodiment of the present invention maybe configured as a square photographing system in which the first,second, third and fourth camera modules 110, 115, 120, and 125 aredisposed at four faces and perform photographing of 360°.

Furthermore, as in FIGS. 43 and 44, each of the first and second linkunits 151 and 152 may be coupled to one side of each of the first andsecond camera modules 110 and 115. Likewise, each of the third andfourth link units 153 and 154 may be coupled to one side of each of thethird and fourth camera modules 120 and 125. The circular plate 150 isfixed between the fixing plates 160 and 161, and may be configured to berotated by a motor.

Furthermore, the circular plate 150 may be configured to include curvegrooves where the first, second, third and fourth link units 151, 152,153 and 154 are coupled and moved.

Accordingly, the first and second camera modules 110 and 115 each areconfigured to have the other side, facing the one side, mutually coupledby hinges. The first and second link units 151 and 152 may move in thecurve grooves by the rotation of the circular plate 150. Likewise, thethird and fourth camera modules 120 and 125 each are configured to havethe other side, facing the one side, mutually coupled by hinges. Thethird and fourth link units 153 and 154 may move in the curve grooves bythe rotation of the circular plate 150.

Accordingly, according to an embodiment of the present invention, anglesformed by the first, second, third and fourth camera modules 110, 115,120, and 125 may be adjusted by the rotation of the circular plate 150.

When the angles between the first, second, third and fourth cameramodules 110, 115, 120, and 125 are adjusted, the angles between thefirst, second, third and fourth camera modules 110, 115, 120, and 125may be adjusted by rotating the circular plate 150 through control ofthe motor, and an optimum image photographing range can be obtainedthrough zoom-in and zoom-out.

According to the present invention, angles of the first, second, thirdand fourth camera modules 110, 115, 120, and 125 may be determined basedon view angles of the first, second, third and fourth camera modules110, 115, 120, and 125.

α=(180°−a)×(2/3)  [Equation 5]

(In this case, a is an angle between the first, second, third and fourthcamera modules, and a is a horizontal view angle of the first, second,third and fourth camera modules)

β=(180°−b)×(1/3)  [Equation 6]

(In this case, β is an angle of the image module of each of the first,second, third and fourth camera modules, and b is a vertical view angleof the first, second, third and fourth camera modules)

According to an embodiment of the present invention, as shown in FIG.43, in order to deploy the first, second, third and fourth cameramodules 110, 115, 120, and 125, angles between the first, second, thirdand fourth camera modules 110, 115, 120, and 125 may be calculated usingEquation 1. An angle of the image module 112 of each of the first,second, third and fourth camera modules 110, 115, 120, and 125 may becalculated using Equation 2 and disposed.

In the detailed description of the present disclosure, such as thatdescribed above, detailed embodiments have been described. However, thepresent disclosure may be modified in various ways without departingfrom the category of the present disclosure. Accordingly, the technicalspirit of the present disclosure should not be limited to theaforementioned embodiments, but should be defined by not only theappended claims, but equivalents thereof.

1. A system for providing a wide-angle image, comprising: a first cameramodule generating a first area image of a first area; a second cameramodule generating a second area image of a second area neighboring thefirst area; and a calibration processor calibrating distortion and aphase difference between the first and second area images andcalibrating superimposition and color of the first and second areaimages whose phase differences have been calibrated.
 2. The system ofclaim 1, wherein the calibration processor comprises: a distortioncalibration unit calibrating the distortion of each of the first andsecond area images; a phase difference calibration unit calibrating thephase difference of each of the first and second area images whosedistortion has been calibrated; an overlap calibration unit calibratingthe first and second area images whose phases have been calibrated in anoverlap manner so that the first and second area images neighbor eachother; and a color calibration unit calibrating the color of thesuperimposed and calibrated overlap image.
 3. The system of claim 2,wherein: the distortion calibration unit calibrates wide-angledistortion of each of the first and second area images and thencalibrates distance distortion, the phase difference calibration unitextracts a horizontal reference point of the first and second areaimages and then adjusts locations of the first and second area images byrotating and moving coordinates, the overlap calibration unit adjusts asize of each of the first and second area images and then adjustslocations of the first and second area images so that the first andsecond area images overlap by moving the coordinates, and the colorcalibration unit calibrates brightness and chromatic aberration of thesuperimposed and calibrated overlap image.
 4. The system of claim 1,wherein the first camera module comprises: a first lens module; a firstimage sensor module generating the first area image of the first areaphotographed through the first lens module; and a first structure inwhich the first lens module and the first image sensor module arereceived, and the second camera module comprises: a second lens module;a second image sensor module generating the second area image of thesecond area photographed through the second lens module; and a secondstructure in which the second lens module and the second image sensormodule are received.
 5. The system of claim 4, further comprising: firstand second link units each coupled to one side of each of the first andsecond camera modules; and a circular plate rotated by a motor andcomprising curve grooves where the respective first and second linkunits are coupled and moved.
 6. The system of claim 5, wherein: thefirst and second camera modules each has the other side, facing the oneside, mutually coupled by hinges, and the first and second link unitsare moved in the curve grooves by the rotation of the circular plate andadjust an angle formed by the first and second camera modules.
 7. Asystem for providing a wide-angle image, comprising: a first cameramodule generating a first area image of a first area; a second cameramodule generating a second area image of a second area neighboring aright of the first area; a third camera module generating a third areaimage of a third area neighboring a lower side of the first area orgenerating a third area image of a third area which is an opposite sideof the first area; a fourth camera module generating a fourth area imageof a fourth area neighboring a lower side of the second area and a rightof the third area or generating a fourth area image of a fourth areawhich is an opposite side of the second area and neighbors a left of thethird area; and a calibration processor calibrating distortion and aphase difference of each of the first, second, third and fourth areaimages and calibrating superimposition and color of the first, second,third and fourth area images whose phase differences have beencalibrated.
 8. The system of claim 7, wherein the calibration processorcomprises: a distortion calibration unit calibrating the distortion ofeach of the first, second, third and fourth area images; a phasedifference calibration unit calibrating the phase difference of each ofthe first, second, third and fourth area images whose distortion hasbeen calibrated; an overlap calibration unit calibrating the first,second, third and fourth area images whose phases have been calibratedin an overlap manner so that the first, second, third and fourth areaimages neighbor each other; and a color calibration unit calibrating thecolor of the superimposed and calibrated overlap image.
 9. The system ofclaim 8, wherein: the distortion calibration unit calibrates wide-angledistortion of each of the first, second, third and fourth area imagesand then calibrates distance distortion, the phase differencecalibration unit extracts a horizontal reference point of the first,second, third and fourth area images and then adjusts locations of thefirst, second, third and fourth area images by rotating and movingcoordinates, the overlap calibration unit adjusts a size of each of thefirst, second, third and fourth area images and then adjusts locationsof the first, second, third and fourth area images so that the first,second, third and fourth area images overlap by moving the coordinates,and the color calibration unit adjusts brightness and chromaticaberration of the superimposed and calibrated overlap image.
 10. Thesystem of claim 7, wherein the first camera module comprises: a firstlens module; a first image sensor module generating the first area imageof the first area photographed through the first lens module; and afirst structure in which the first lens module and the first imagesensor module are received, the second camera module comprises: a secondlens module; a second image sensor module generating the second areaimage of the second area photographed through the second lens module;and a second structure in which the second lens module and the secondimage sensor module are received, the third camera module comprises: athird lens module; a third image sensor module generating the third areaimage of the third area photographed through the third lens module; anda third structure in which the third lens module and the third imagesensor module are received, and the fourth camera module comprises: afourth lens module; a fourth image sensor module generating the fourtharea image of the fourth area photographed through the fourth lensmodule; and a fourth structure in which the fourth lens module and thefourth image sensor module are received.
 11. The system of claim 10,further comprising: first and second link units each coupled to one sideof each of the first and second camera modules; third and fourth linkunits each coupled to one side of each of the third and fourth cameramodules; and a circular plate rotated by a motor and comprising curvegrooves where the first, second, third and fourth link units are coupledand moved.
 12. The system of claim 11, wherein: the first and secondcamera modules each have the other side, facing the one side, mutuallycoupled by hinges, the third and fourth camera modules each have theother side, facing the one side, mutually coupled by hinges, the firstand second link units are moved in the curve grooves by the rotation ofthe circular plate and adjust an angle formed by the first and secondcamera modules, and the third and fourth link units are moved in thecurve grooves by the rotation of the circular plate and adjust an angleformed by the third and fourth camera modules.